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© Television scan line doubler including temporal median filter. 



© A video pixel interpolator generates interpolation 
pixels from incoming picture image pixels for use 
within a television picture scan line doubler system. 
The interpolator includes a temporal median filter 
(22) for generating an interpolation pixel by selection 
of the median one of a plurality of temporal pixel 
samples derived from incoming video, an intra-field 
averager means (28) for generating an intra-fieid 
^ pixel average, and a switch (26) connected to switch 
^an input to a line doubler of the system between 
outputs of the temporal median filter and the intra- 
Jfield averager in response to detection of pixel mo- 
©tion within the picture image. Improved motion de- 
tection, and multi-channel processing are also in- 
0) eluded within the present invention. 
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Television scan line doubler including temporal median filter 



THIS INVENTION relates to scan line doublers 
for increasing the number of apparent scan lines of 
a display device to reduce the visibility of the scan 
line structure of the picture image. More particu- 
larly, the present invention relates to a television 
scan line doubler which includes a temporal 
median filter and motion detector. 

When all other sources of error and distortion 
have been removed or minimized by correction or 
compensation, standard NTSC colour video picture 
images become limited in quality by perceptibility 
of the line scan structure. Subjective visibility of the 
line scan structure is a direct consequence of the 
limited number of horizontal scan lines in the stan- 
dard composite picture, and is further a direct 
consequence of field by field interlace. A conven- 
tional television frame at a 30 Hz repetition rate is 
composed of two fields, e.g. F0 and F1 . Each field 
includes 262.5 scan lines which are separated by 
unilluminated strips or bands. Successive fields are 
offset so that the scan lines of the next field oc- 
cupy the unilluminated strips of the present field. 
This arrangement is followed to minimize percep- 
tion of 30 Hz flicker in the resultant picture display. 

However, with development of high resolution 
display devices and large screen formats, the visi- 
bility of the basic line scan structure has become 
the most pronounced limitation of the conventional 

of proposals for high definition television or 
"HDTV W . A main drawback of most HDTV formats 
is that they are not downwardly compatible with 
existing transmission and reception equipment, 
equipment which represents an enormous invest- 
ment. 

One approach for reducing the visibility of the 
line scan structure of the television image calls for 
estimating or interpolating picture elements for ad- 
ditional scan lines from the picture elements al- 
ready present in the picture image scanned in the 
conventional format. This prior approach is known 
in the art as "time compression" or "scan lines 
doubling", and it calls for doubling the number of 
scan lines from 262.5 lines per field to 525 lines 
per field. Thus, 525 scan lines are presented each 
60th of a second. 

One prior approach to pixel interpolation is 
carried out by an intra-field or spatial domain pro- 
cess. The pixel for the unilluminated band between 
two scan lines is derived as the average of the 
pixel amplitude (and hue) of the pixel in the scan 
line directly above and of the pixel in the scan line 
directly below. This approach may be followed with 
relatively simple circuit implementation. Its main 
drawback is the reduced resolution or softness of 



the resultant picture image in the vertical dimen- 
sion at edges and some perceptible 30 Hz vertical 
domain flicker in the instance of sharp vertical 
transitions within the picture image. 
5 Another prior approach to line doubling op- 

erates on an inter-field basis, in this approach, the 
pixel to be interpolated for a new scan line in the 
present field is obtained as the pixel value from the 
scan line of the prior field at the same spatial 
10 location of the picture image. This inter-field ap- 
proach requires a field period delay and is much 
more expensive to implement than the intra-field 
approach. However, when there is no motion in the 
picture, a very high resolution picture display re- 
is suits. When there is motion, the inter-field ap- 
proach completely breaks down. In the presence of 
motion, the objects in motion are accompanied by 
double image ghosts or aliases, ragged sawtooth 
patterns on vertical edges in the picture and flicker- 
20 ing at the 30 Hz rate along motion transition edges. 
With an otherwise noise-free picture, a motion val- 
ue of 2 IRE units, for example, will result in visible 
double image aliases with this prior approach. 

Thus, the inter-field approach to pixel interpola- 
25 tion has not been successfully used in line dou- 
blers without some mechanism for motion adapta- 
tion. Motion adaptation circuits add further expense 
to this approach. With a motion adaptation circuit, it 
^ r bas^hen^beeft.possible to construct ajme^toipter 
30 which switches from the higher resolution inter-field 
approach to the lower resolution intra-field ap- 
proach whenever motion is detected within the 
picture image. Such an approach is described and 
discussed in conjunction with Figure 13 of Powers 
35 U.S. Patent No. 4,400,719 entitled "Television Dis- 
play System with Reduced Line-Scan Artifacts". 

Since most -television picture content derived 
from reality includes a significant motion content, 
the prior art inter-field line doublers handled the 
40 motion content by switching to intra-field spatial 
domain interpolation, for example. A significant 
drawback of the prior art inter-field line doublers is 
that they have needed to be switched at a very low 
motion level to the spatial domain interpolation in 
45 order to avoid objectionable artifacts in the resul- 
tant picture. With such a low a switch threshold 
being required, the switching has been triggered 
by noise in the picture and has resulted in a noisier 
picture with intra-field interpolation, 
so A temporal median filter has been proposed for 

use within a television receiver in a paper by C. 
Hentschel entitled "Linear and Non-Linear Proce- 
dures for Flicker Reduction" presented at the 1987 
IEEE International Conference on Consumer Elec- 
tronics and published in the Digest of Technical 
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Papers at pages 174 and 175. However, in that 
approach two new fields were derived by temporai 
median filter interpolation and inserted in a field- 
doubled display. There is no teaching or sugges- 
tion in the published paper of a temporal median 
filter for use within an inter-field scan line doubier 
structure. 

Thus, a hitherto unsolved need exists for an 
inter-field line doubier which enables temporal in- 
terpolation of pixels at a higher motion threshold 
than heretofore without generation of objectionable 
artifacts. 

Objects in motion within the video picture must 
still be detected, so that temporal pixel (field dif- 
ference) interpolation processes are discontinued in 
favour of spatial pixel (line difference) interpolation 
processes. While field-recursive motion detection 
has been proposed by the Tonge et al U.S. Patent 
No. 4,730,217 in order to bridge spectral gaps 
occurring in certain conditions of motion within the 
picture, the recursive approach taken therein pro- 
vides for recirculation or feedback of the overall 
motion control signal itself, rather than one compo- 
nent or aspect thereof. The Tonge et al overall 
recirculation technique employed field delay recir- 
culation. The Tonge et al definition of "field" is 
unclear. If "field" as used by Tonge et al meant 
262 lines, the resultant recirculation would cause a 
spread or crawl upwardly into the vertical domain. 
If "field" as used by Tonge et al meant 263 lines, 
downward spread or crawl into the vertical domain 
resulted. In any event, the Tonge et al approach 
resulted in an undue vertical spreading of the mo- 
tion control signal and did not aid or foster devel- 
opment of a motion control signal which is related 
in amplitude or value to overall magnitude of the 
motion event being detected. The practical con- 
sequence of the Tonge et al approach was that the 
pixel interpolator switched to a spatial domain inter- 
polation process too frequently and for too long a 
time, thereby resulting in a picture of lesser resolu- 
tion than necessary. 

Thus, a further hitherto unsolved need exists 
for an improved motion detector which enables 
development of a proportional interpolation process 
switching control signal while still covering spectral 
gaps occurring from some picture motion condi- 
tions. 

A general object of the present invention is to 
provide an improved method and apparatus for 
television scan line doubling and display which 
achieves pixel interpolation in a manner which 
overcomes limitations and drawbacks of the prior 
art. 

A more specific object of the present invention 
is to provide an inter-field line doubier for a line 
doubled television display so as to eliminate the 
double imaging artifact otherwise occurring in prior 



art inter-field interpolation processes in the pres- 
ence of motion in the field to field picture content. 

Another specific object of the present invention 
is to provide an improved motion detector for pro- 

5 portionally controlling an interpolator for a television 
scan line doubier which normally interpolates pixels 
on the basis of median values derived in the tem- 
poral domain and which switches to spatial domain 
pixel interpolation in the presence of detected mo- 

10 Won within the video picture. 

A further specific object of the present inven- 
tion is to provide an improved interpolator for a 
television scan line doubier which switches incre- 
mentally from a temporal median filter output to a 

15 spatial interpolation value in relation to amplitude of 
a motion value derived from the motion activity in 
the vicinity of the pixel to be interpolated. 

In accordance with the present invention, a 
television tine doubier doubles the number of scan 

so lines available for display upon a television display 
device. The line doubier includes a temporal 
median filter which is connected to receive simulta- 
neously and select and put out the median one as 
an interpolation pixel Fli in a one field delayed Fi 

25 field, the interpolation pixel Fii being selected from 
a group including an actual pixel value from a 
present field F0, a pixel average value in the F1 
field of F1(a + b)/2 wherein a is the pixel in the 
scan line above the pixel i location and b is the 

30 pixel in the scan line below the pixel i location, and 
an actual pixel value from a two field delayed field 
F2. The line doubier further includes a real pixel 
time compression circuit connected to time com- 
press the pixels of each scan line of the F1 field 

35 into half of the original scan time and to put out 
time compressed scan lines during a first double 
scan rate line scan interval; and, an interpolated 
pixel time compression circuit connected to time 
compress the interpolated pixels i of each scan line 

40 put out by the temporal median filter into half of the 
original scan time and to put out the time com- 
pressed scan lines during a second double scan 
rate line scan interval. Finally, the line doubier 
includes a switch for switching between the outputs 

45 of the real pixel time compression circuit and the 
interpolated pixel time compression circuit, for put- 
ting out line doubled video to the display device. 

The television line doubier may further com- 
prise an intra-fietd pixel interpolator for putting out 

so as an interpolated pixel the Fl(a + b)/2 intra-field 
average value, and a second switch connected to 
switch between the output of the temporal median 
filter and the output of the temporal median filter 
and the output of the intra-field pixel interpolator, 

55 and a multi-component motion detector including at 
least one frame-recursive component for detecting 
a motion value In the vicinity of the pixel i to be 
interpolated for causing the second switch to 
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switch its output to the interpolated pixel time com- 
pression circuit from the temporal median filter to 
the intra-field interpolator in accordance with the 
motion value. 

Preferably, the multi-component motion detec- 
tor and the second switch of the television line 
doubier provide a proportional switch which switch- 
es in accordance with absolute amplitude of the 
motion value. 

Desirably, the switching characteristic of the 
proportional switch has an onset at approximately 2 
to 5 IRE units of motion value amplitude and 
reaches full switchover to the intra-fieid interpolator 
means at approximately 5 to 15 IRE units of motion 
value amplitude. 

In another aspect of the present invention, a 
motion detector determines motion activity in the 
immediate vicinity of the pixel to be interpolated 
and stretches this motion to a predetermined num- 
ber of adjacent pixel locations in the line domain. A 
recirculation loop enables a component of motion 
to be recirculated and thereby to cover some spec- 
tral gaps occurring under certain motion conditions 
without spreading in the vertical domain. 

In order that the invention may be more readily 
understood, an embodiment thereof will now be 
described, by way of example, with reference to 
the accompanying drawings, in which: 

Figure 1 is a greatly enlarged time slice of a 
portion of a conventional raster scan of picture 
elements depicted for three fields as small circles, 
with a picture element to be interpolated being 
depicted as a solid dot; 

Figure 2 is an overview block diagram of a 
television scan line doubier including a temporal 
median filter in accordance with the present inven- 
tion; 

Figure 3 is a detailed block diagram of a 
preferred embodiment of a multi-component motion 
detector for inclusion within the Figure 2 scan line 
doubier; 

Figure 4 is a graph of the switching char- 
acteristics of a proportional switch included within 
the Figure 2 scan line doubier; 

Figure 4 is a graph of the switching char- 
acteristics of a proportional switch included within 
the Figure 2 scan line doubier; 

Figure 5 is a pictorial graph of an area of the 
television picture image surrounding the pixel to be 
interpolated which is considered for motion am- 
plitude in deriving the motion signal depicted on 
the vertical axis of the Figure 4 graph; 

Figure 6A is a block diagram of a temporal 
median filter included within the Figure 2 scan line 
doubier; 

Figure 6B is a state table illustrative of 
median value selection operation of the Figure 6A 
temporal median filter; 
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Figure 7 is a more detailed block diagram of 
a digital colour scan line doubier including temporal 
median filtering within luminance and chominance 
paths wherein the filtering in both paths is under 

5 the general control of a single motion detector 
operating upon luminance values and wherein 
chrominance control is overriden by a colour level 
detector circuit responsive to some picture con- 
ditions, post line doubling processes including en- 

10 hancement and transcoding also being shown; and 
Figure 8 is a graph of the characteristics of 
the colour level detector circuit included within the 
Figure 7 line doubier system. 

Figure 1 depicts a diagrammatic view of the 

75 edge of a raster scan display spread horizontally 
along a time plane. In this figure there are three 
vertical columns of picture elements (pixels), denot- 
ing three successive scan fields, the present field 
FO, a once prior field F1 (reference field), and a 

20 twice prior field F2. Each original or real pixel of 
the conventional scan, i.e. one derived from a cam- 
era scan of some visual image, etc., is denoted by 
a small circle which generally approximates its 
position in vertical display space and in time along 

25 the horizontal axis. One pixel i within the F1 refer- 
ence field to be derived by interpolated is shown in 
Figure 1 by a solid dot at a position equidistant 
between four real pixels, pixels a and b of F1 , pixel 
c of FO, and pixel d of F2. Pixels a and b of F1 

30 denote adjacent original scan lines within the F1 
field. The location of the interpolated pixel i de- 
notes the location of the unilluminated band be- 
tween the two adjacent scan lines. Pixel c and d 
illustrate the interlace process by which, for exam- 

35 pie, pixel d previously illuminated the band in 
question and pixel c will illuminate the band left 
dark in the F1 field. 

By inspection of Figure 1, in the absence of 
motion or change in the picture content, pixel i is 

40 best represented by pixel c or d, either one of 
which aligns exactly with the unoccupied pixel 
space i to be filled in by interpolation. On the other 
hand, if there is motion at the vicinity of pixel i, the 
time delay between fields F2 and FO, one thirtieth 

45 of a second in the conventional NTSC scan format, 
is sufficient to cause a visual artifact at that site at 
a 30 Hz flicker rate if either the FO or F2 pixels c or 
d are used in the interpolation process. In that 
situation, the practice has been to interpolate pixel i 

so as an average of pixels a and b. 

It has now been discovered that pixel interpola- 
tion within many visual motion conditions may be 
more accurately approximated by use of a tempo- 
ral median filter than with the methods employed in 

55 the prior art. In the Figure 1 example, the temporal 
median for the pixel i is the one of the pixels FOc, 
F1(a + b)/2 or F2d having an amplitude lying 
between the amplitudes of the other two choices. 

4 
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This temporal median filter approach has been 
found to work very well without any noticeable 
resultant artifacts in most picture motion conditions. 
It generally eliminates the double image artifact, 
and its failure modes occur infrequently and with 
little overall picture quality degradation. (One infre- 
quently encountered failure mode is the case of 
moving small objects and impulses wherein the 
rate of movement results in a spatial displacement 
which is greater than the size of the object or 
impulse). This approach yields a line doubled pic- 
ture image having higher resolution more often 
than heretofore obtained. 

Thus, by using a temporal median filter in 
place of other temporal interpolation processes, the 
major artifacts in motion are eliminated or signifi- 
cantly reduced, and when combined with switching 
to a spatial domain interpolation with high motion 
content, a picture with less artifacts is obtained, 
even in the presence of motion. In this regard, it is 
practical, for example, to detect motion at the out- 
put of the temporal median filter. 

A system 10 employing the principles of the 
present invention is shown in structural overview in 
Figure 2. An input 12 receives a one field delayed 
signal (denoted F1 in Figure 1). This incoming 
video signal may be monochrome video or it may 
be the luminance component of a composite colour 
television signal. K has the characteristics ascribed 
to it as explained in conjunction with Figure 1 . The 
F1 signal on the line 12 is passed through a 
conventional time compression circuit 14, such as 
a scan line first in/first out (FIFO) buffer memory 
which is written at the incoming pixel quantization 
rate (typically four times the colour subcarrier fre- 
quency or M 4X") and which is read out at twice the 
incoming pixel quantization rate (or "8X"). The 
circuit 14 typically includes separate write and read 
pointers and is arranged as a ring memory array. 
Its output leads to a switch circuit 16 which is 
switched at twice the horizontal line scan rate (i.e.* 
15 kHz in the NTSC format). The switch 16 recur- 
rently selects between a scan line of original pixels 
from the real pixel time compressor 14 and a scan 
line of Interpolated pixels on a line 18. Thus, an 
output 20 of the line doubler 10 provides two scan 
lines in the time originally accorded to a single 
scan line. 

A temporal median filter interpolar 22 receives 
three inputs: an F0 field input; an F1 (a + b)/2 
present field spatial average input; and an F2 field 
input. The F2 input represents the field occurring 
just before the F1 present field, and the FO input 
represents the field occurring just after the F1 
present field. Thus, the present field F1 spatial 
average input implies that this point has been de- 
layed by one-field from actual incoming video at 
the conventional scan rate. The temporal median 
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filter interpolator 22 determines and puts out the 
median one of the three inputs for each pixel to be 
interpolated. The output from the temporal median 
filter 22 is passed through an interpolated pixel 

s time compression circuit 24, which operates in the 
same fashion as described for the real pixel time 
compressor 14, except that the output on the line 
18 is timed to be in synchronism with the switch 16 
at the 15 kHz line scan rate. 

io A minimum system configuration embodying 

the present invention would include elements 14, 
16, 2 and 24. This minimum configuration system 
works very well in most motion conditions and can 
be further improved by addition of switch 26, a 

is spatial or intra-field interpolator 28 and a motion 
detector 30 to control the switch 26. The switch 26 
is shown in the no-motion or low-motion position 
and switches to the output of the intra-field inter- 
polator 28 when motion amplitude in the vicinity of 

20 the pixel to be interpolated is at or above a switch- 
ing threshold, such as 3-7 IRE units. One suitable 
pixel motion neighbourhood is shown greatly en- 
larged in Figure 5 and discussed hereinafter in 
connection therewith. Motion occurring within this 

25 neighbourhood or vicinity of the interpolation pixel i 
is considered in development of a motion control 
signal for controlling operation of the switch 26. 

While a motion detector may operate in any 
fashion known in the prior art in order to develop 

30 an absolute motion amplitude value in the vicinity 
of the pixel i to be interpolated, the motion detector 
30 depicted and discussed in conjunction with Fig- 
ure 3 hereof offers superior motion detection per- 
formance and is presently preferred. 

35 As shown in Figure 2, the switch 26 is depicted 

as a fader which normally selects the median pixel 
output on a line 23 and which switches increment- 
ally or proportionally to the spatial average value 
on a line 25 from the spatial interpolator 28, with 

40 switching being in relation to the magnitude of the 
control signal on the line 27. A smooth and fairly 
linear switching characteristic is provided on the 
line 27 for controlling the fader 26, as graphed in 
Figure 4. 

45 In practice, the switch 26 may be implemented 

as two fractional multipliers. One multiplier mul- 
tiplies the signal on the line 29 by a control value k 
while the other multiplier multiplies the signal on 
the line 23 by a function (i-k), wherein the control 

so value k has a fractional value lying between zero 
and unity. Eight steps for k have been used in 
practice with very satisfactory results, and these 
eight incremental levels are graphed in Figure 4, 
for example. 

55 The motion control value k on the line 27 is a 

function of the amplitude of motion activity at the 
vicinity or neighbourhood of the pixel i to be inter- 
polated. While the motion amplitude may be ob- 
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tained in any known way, one satisfactory way is to 
create a motion signal as the difference of FO and 
F2 pixels and then carry out a summation of mo- 
tion signals so derived at several adjacent pixel 
positions immediately to the right and to the left of s 
the pixel to be interpolated within the same scan 
line time domain. This results in selection of the 
largest component of motion values at the vicinity 
of the pixel to be interpolated. 

Figure 3 sets forth a block diagram of the w 
presently preferred implementation of the motion 
detector 30. The presently incoming luminance 
pixel stream FO is subtracted from the two-field- 
delayed luminance pixel stream F2 in a subtracter 
32 which generates an output indicative of the 75 
difference in magnitude between a present pixel, 
such as the pixel c of Figure 1 and a two-field- 
delayed, spatially aligned pixel, such as the pixel d 
of Figure 1 , for example. This difference is then low 
pass filtered in a horizontal low pass filter 34 hav- 20 
ing a roll off at approximately 3 MHz to eliminate 
any residual high frequency components which 
may include noise, chroma sideband pollution, etc. 

The sign of the pixel difference value is re- 
moved by action of a sign eliminator graphed for 25 
illustration as a full wave rectifier 36. The output of 
the sign eliminator 36 is defined to represent mo- 
tion or change in the picture luminance content at 
the present pixel location without regard to the 
direction of the transition as from black level to 30 
white level, or from white to black. An output line 

gat© 40 which selects and puts out the largest 
value present on a plurality of inputs. 

The line 40 also extends through an amplifier 35 
42 having a preselected, controllable gain factor, 
alpha, which lies between zero and unity. The 
output of the amplifier 42 leads to a summing 
junction 44 whose output extends to an amplifier 46 
having a preselected, controllable gain factor, gam- 40 
ma. The output from the amplifier 46 extends over 
a line 48 to another Input of the OR gate 40. The 
output from the summing junction 44 also extends 
through a frame delay 50 which delays the 
summed signal by one video frame period (i.e. 525 45 
scan lines in the NTSC picture format). An output 
line 52 from the frame delay leads to an amplifier 
54 having a predetermined, controllable gain factor, 
delta. An output line 56 from the amplifier 54 
extends to a third input of the OR gate 40. so 

The output line 52 also extends to a recircula- 
tion path including a limiter and threshold circuit 58 
and an amplifier 60 having a predetermined, con- 
trollable gain factor, beta. The output from the 
amplifier 60 is fed back to the summing junction 55 
44. The degree of frame recirculation is controlled 
by controlling the gain beta of the amplifier 60 
which is always in a range from zero to unity. The 



gains gamma and delta of the amplifiers 46 and 54 
are controlled in order to provide normalized mo- 
tion vlaue, given the motion value present on the 
line 38 as a reference. In this regard, it is important 
to note that motion is only determined to be 
present when there is an instant difference between 
an F0 pixel and a corresponding F2 pixel. If, for 
example, a string of pixel difference values (motion 
values) occur, the recirculation path provided by 
the iimiter/threshold 58, amplifier 60 and summing 
junction 44, will fill in any holes that might other- 
wise occur, given motion velocities and object di- 
mensions within the picture. By using a frame 
delay 50, the motion differences are spread out 
along the temporal domain without any spread in 
the vertical domain, as would occur if a field delay 
were employed for the delay 50, as has been 
suggested by the Tonge et al. reference cited 
above. 

The output from the OR gate 40 passes 
through a limiter and threshold circuit 62 which 
implements a minimum motion signal amplitude 
threshold, such as 3 IRE units, below which there 
will be no switching. The actual threshold may be 
set to have an onset within the preferred range of 2 
to 10 IRE units and to reach full switchover within 
the preferred range of 5 to 15 IRE units, as graph- 
ed in Figure 4. The limiting action of the circuit 62 
limits switching action to a maximum of unity ir- 
respective of actual amplitude of the motion signal 
above e.g. 15 IRE units. 

implemented with a recirculating pipeline delay 
clocked at the pixel rate and an OR gate, causes 
the motion signal to be stretched in the horizontal 
domain over a plurality, such as six, adjacent pix- 
els, thereby to provide a horizontal domain neigh- 
bourhood for the motion signal. While one line of 
vertical stretching is required, further stretching into 
the vertical domain, as suggested by the Figure 5 
graph, may be optionally included to extend the 
motion neighbourhood vertically above and below 
the a and b pixels of the reference field F1 , also by 
inclusion of suitable line delays and recirculation. 
Any benefit resulting from vertical stretching must 
be balanced by the cost of implementation of the 
vertical stretching circuitry. 

An output line 66 from the horizontal stretching 
circuit 64 leads directly to one input of an OR array 
76; it also leads to a 262 line delay 68 having an 
output 70 leading to another input of the OR array 
76. The output 70 also leads through a one line 
delay 72 whose output 74 goes to a third input of 
the OR array 76. The OR array 76 selects the input 
having the highest motion amplitude value and puts 
it out as the three bit motion control value on the 
line 27 to control operation of the switch 26. 

The output line 66 from the horizontal stretch 
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circuit 64 carries the F0 pixel c and the F2 pixel d. 
By providing the 262 line delay 68, the F1 pixel a 
is obtained, and by providing the one line delay 72, 
the F1 pixel b is obtained. Thus, all of the pixel 
positions directly surrounding the pixel i to be 
interpolated are considered for motion by the mo- 
tion detector 30. 

The motion control signal k operates the switch 
26 in accordance with the graph shown in Figure 4. 
This graph shows that operation of the switch 26 
begins at about 3 IRE units of sensed motion 
magnitude at the vicinity of the pixel to be interpo- 
lated and incrementally progressing to full switch- 
ing action by about 7 IRE units of amplitude of 
detected motion. The 3 IRE units starting point is 
selected to be above any noise level in the picture 
signal that would otherwise be understood as mo- 
tion. A level in a range between 1 and 10 IRE units 
should be satisfactory, depending upon the char- 
acteristics and method of derivation of the motion 
control signal. Similarly, a full switching action point 
of 5 to 15 IRE units should be satisfactory. It has 
been found that the system 10 works best if full 
switching occurs at a relatively fast rate and with a 
smooth incremental action. Eight switch steps have 
been found to be satisfactory, and the line 27 may 
be a three bit bus. 

A motion neighbourhood of pixels surrounding 
the pixel i to be interpolated at any instant is 
considered for motion level. Motion activity within 
this neighbourhood, which is dimensionally exag- 
gerated in Figure 5 graph, is low pass filtered to 
remove noise. The resultant motion value, which 
represents absolute amplitude of summed motion 
activity within the neighbourhood irrespective of 
direction, is displayed along the vertical axis of the 
Figure 4 graph, and results in he quantized three 
bit (eight level) switch control value on the line 27 
to control the fader 26. While eight switch steps are 
presently preferred, the switching characteristic of 
the fader 26 may follow a wide variety of patterns 
or steps. Preferably, the characteristic should be 
substantially linear and should be very fast. In the 
picture content, the motion neighbourhood only oc- 
curs for edges in motion or transition. The body of 
the object in motion will not be treated as being in 
motion unless edge details are present within the 
definition of the body. Also, most low level details 
are adequately handled by the temporal median 
filter 22 without swtiching to the spatial pixel inter- 
polator 28. Thus, a higher resolution, line doubled 
picture image is obtained with the system 10 than 
heretofore. 

With reference to Figure 6A, further structural 
details of one preferred embodiment of the tempo- 
ral median filter 22 are set forth. As shown in 
Figure 2, the temporal median filter 22 receives F0, 
F1 (a + b)/2 and F2 pixel values as already ex- 



plained in conjunction with Figure 1. A comparator 
80 compares F0 and F2 and puts out a value D2. 
The value D2 is one if F0 is greater than F2 and is 
zero if F0 is less than or equal to F2. A comparator 

s 82 compares F1 (a + b)/2 <"F1 M ) and F2 and puts 
out a value D1 . The value D1 is one if F1 is greater 
than F2 and is zero if F1 is less than or equal to 
F2. A comparator 84 compares F1 and Fo and puts 
out a value DO. The value DO is one if F1 is greater 

10 than F0 and is zero if F1 is less than or equal to 
FO. The D2, D1 and DO outputs of the comparators 
80, 82 and 84 address a lookup table 86 imple- 
mented within a programmable read only memory 
array, for example. The table 86 puts out three data 

is values BAR Q2. BAR Q1. and BAR Q0. The BAR 
QO (logical low or zero level control active) signal 
enables an F0 latch 88 and places the FO value on 
the output bus 23. The BAR Q1 signai enables an 
F1 latch 90 and places the F1 value on the output 

20 bus 23. The BAR Q2 signal enables an F2 latch 92 
and places the F2 value on the output bus 23. Only 
one of the latches 88, 90 and 92 may be active for 
any pixel to be interpolated. 

Figure 68 sets forth a state table which cor- 

25 relates the input values D2, D1 and DO with the 
output values Q2, Q1 and Q0 put out by the state 
tabie memory 86. The amplitudes of F0, F1 and F2 
are also indicated for each output condition. A zero 
value for one of the output values Q2, Q1 or Q0 

30 indicates that that particular value is selected. Only 
outputs having one zero are legal, thereby assuring 
that only one of the latches 88, 90 and 92 will be 
active at any one time. 

Care must be taken in assembling the Figure 2 

35 system to be sure that proper time delays are 
inserted in the lines 23 and 29 before the switch 26 
and that the motion control singal k on the line 27 
is wider than and generally centered in time about 
the pixel I to be interpolated. 

40 Held and line delays to achieve the F1 (a + 

b)/2 and F2 functions may be implemented with 
readily available digital memory devices and trim 
delays needed for compensating for process de- 
lays may also be implemented with digital memo- 

45 ries and programmable address counters. Address- 
ing of the memories may be carried out by coun- 
ters programmed as modulo-n counters where n 
represents the total delay period desired. 

A line doubler system 100 for composite colour 

so picture images may preferably be implemented in 
accordance with Figure 7 by duplicating the Figure 
2 structure for time multiplexed preferably equally 
components corresponding to those found in Fig- 
ure 2 include a w Y rt suffix with each reference 

55 numeral, while the chrominance components found 
in Figure 2 include a n C n suffix. The motion detec- 
tor circuit 30 operating upon luminance pixel in- 
formation within a luminance interpolator imple- 
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merited in accordance with the Figure 2 system 10 
may be used to control interpolation of a parallel 
chrominance interpolator which is also implement- 
ed in accordance with the Figure 2 architecture. 
Also, the median determining elements 80, 82, 84 
and 86 of the luminance median temporal filter 22Y 
(Figure 7) may be used to control selection of the 
chrominance median pixel value at a chrominance 
temporal median selector 25 via selection values 
sent via a control bus 31 from the luminance 
median temporal filter 22 Y to the chroma median 
selector 25. With this arrangement, the same Fig- 
ure 8 comparisons are used to select and put out 
both the luminance and chrominance interpolation 
pixels based on derivation of the median of the 
incoming luminance values, F0, F1 and F2. 

Some further improvement in chrominance 
pixel interpolation may be obtained if a red hue 
level detector 94 is also included in series with the 
motion control 30 leading to the chroma fader 26C. 
The red level detector 94 switches the chroma 
interpolator from the temporal median filter 22C to 
the spatial interpolator 28C whenever a predeter- 
mined hue, such as red level, reaches a predeter- 
mined level, such as 30 and 50 IRE units. The 
switching control characteristic imposed by the de- 
tector 94 is graphed in the graph of Figure 8. As 
seen therein, the onset "knee" for chroma control 
override lies in a range extending from e.g. 30 to 
50 IRE units. The full-on switch knee extends in a 
range from 60 to 80 IRE units. The slope between 
onse|an d jull- pn i g t c j ^irj^lvg^^ 

By including the red hue level detector a situ- 
ation where there is colour motion with no cor- 
responding change in luminance amplitudes, as 
when an orange soccer ball is seen travelling 
across a bright green playing field, for example, 
causes switching to the spatial domain interpolation 
process within the chrominance path with no cor- 
responding resolution degradation within the lu- 
minance path. 

Since resolution is not as critical an issue with 
chroma information, a colour line doubler system 
including only a spatial domain pixel interpolator for 
chrominance, such as the interpolator 28 of Figure 
2, will also work very satisfactorily and may be 
realised at less complexity and cost than a colour 
system which duplicates the Figure 2 architecture 
for the chroma pixel interpolation path. 

Delay matches 96 and 98 provide suitable de- 
lay matching for the real F1 luminance and 
chrominance pixels so as to match the delays 
incident to the interpolation processes. The first in- 
first out line stores 14Y and C and 24Y and C are 
simultaneously written with delay matched real and 
interpolated pixels at the 4X original quantization 
rate whereas they are read out at the line doubled 
8X rate, first one and then the other. The switches 
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16Y and C are operated by the 2H signal to select 
the output from one of the FIFOS 14 and 24 during 
the first half of an original line scan interval and 
then to select the output from the other of the 
FIFOs 14 and 24 during the remaining half of the 
original line scan interval. 

In the digital colour line doubler implementation 
100 such as shown in Figure 7 wherein luminance 
and chrominance pixel values are converted to and 
processed for interpolation and line doubling as 
digital values such as a 8 bit bytes, a very stable 
clock is required for satisfactory operation of the 
system 10, since any phase jitter of the clock will 
be incorrectly construed as motion, with adverse 
consequences. Phase lock techniques are appro- 
priately employed in the system clock which gen- 
erates zX, 4X and 8X, and 2H driving signals, 
wherein X may be related to the colour subcarrier 
frequency or to the horizontal line scan frequency, 
and H is the original line scan rate. Time multiplex- 
ing of chroma bytes, e.g. red minus luminance (R- 
Y) and blue minus luminance (B-Y) at a 2X quan- 
tization rate enables a single interpolator to handle 
all of the chroma information. 

The Figure 7 colour line doubler 100 may 
include vertical detail enhancement within the digi- 
tal line doubler element 102 and it may further 
include other known enhancement processess with- 
in an analog converter 106 converts the time com- 
pressed luminance pixels into an analog data 
stream, and a digital to analog converter 108 co- 

, y^r^4^ into ^angXtm^^g 

stream. 

From the foregoing, it is readily apparent that a 
single, dual or triple channel system may be con- 
structed and used. For example, processing may 
be of luminance alone, or red minus luminance and 
blue minus luminance (R-Y and B-Y) or a multi- 
channel system in which red, gree and blue are 
separately processed. 

While the method and apparatus of the present 
invention have been summarised and explained by 
an illustrative application in television line doubling 
including a temporal median filter interpolator, it will 
be readily apparent to those skilled in the art that 
many widely varying embodiments and applica- 
tions are within the teaching and scope of the 
present invention, and that the examples presented 
herein are by way of illustration only and should 
not be construed as limiting the scope of this 
invention. 

The features disclosed in the foregoing de- 
scription, in the following claims and/or in the ac- 
companying drawings may. both separately and in 
any combination thereof, be material for realising 
the invention in diverse forms thereof. 
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Claims 

1. A television line doubler for doubling the 
number of scan lines available from incoming video 
for display upon a display device, the line doubler 
comprising interpolation means (22) for generating 
an interpolation pixel i in a one field delayed F1 
field, real pixel time compression means (14) con- 
nected to time compress the pixels of each scan 
line of the F1 field into half of the original scan time 
and to put out time compressed scan lines during a 
first double scan rate line scan interval, interpolated 
pixel time compression means (24) connected to 
time compress the interpolated pixels i of each 
scan line put out by the interpolation means (22) 
into half of the original scan time and to put out the 
time compressed scan lines during a second dou- 
ble scan rate line scan interval, and switch means 
(16) for switching between the outputs of the real 
pixel time compression means (14) and the interpo- 
lated pixel time compression means (24) for putting 
out line doubled video to the display device, the 
line doubler being characterised in that the inter- 
polation means (22) comprises temporal median 
filter means for generating the interpolation pixel i 
by selecting the median one of a group of temporal 
pixel values derived from the incoming video. 

2. A television line doubler according to claim 
1, wherein the group of temporal pixel values in- 
cludes an actual pixel value c from a present field 
F0, a pixel average value of F1 (a + b)/2 in the F2 
field where a is the pixel in the scan line above the 
pixel i location and b is the pixel in the scan line 
below the pixel i location, and an actual pixel value 
d form a two field delayed field F2. 

3. A television line doubler according to claim 1 
or 2, comprising intra-field pixel interpolator means 
(28) for putting out as an interpolated pixel the F1 (a 
+ b)/2 intra-field average value, second switch 
means (26) connected to switch between the out- 
put of the temporal median filter means (22) and 
the output of the intra-field pixel interpolator means 
(28), and motion detection means (30) for detecting 
a motion value in the vicinity of the pixel i to be 
interpolated for causing the second switch means 
(26) to switch its output to the interpolated pixel 
time compression means (24) from the temporal 
median filter means (22) to the intra-field interpola- 
tor means (28) in accordance with the motion val- 
ue. 

4. A television line doubler according to claim 

3, wherein the second switch means (26) is a 
proportional switch which switches in accordance 
with absolute amplitude of the motion value. 

5. A television line doubler according to claim 

4, wherein the switching characteristic of the pro- 
portional switch (26) has an onset at approximately 
2 to 5 IRE units of motion value amplitude and 



reaches full switch over to the intra-field interpola- 
tor means (28) at approximately 5 to 15 IRE units 
of motion value amplitude. 

6. A television line doubler according to any 
5 one of claims 1 to 5, comprising an input for 

receiving pixel values from a present field F0, a 
first field delay means connected to the input and 
having an output F1a, a first line delay means 
connected to the output of the first field delay 

70 means and having an output F1b, a second field 
delay means connected to the output of the first 
tine delay means and having an output F2, and an 
- averager means connected to average the output 
of the first field delay line means and the first line 

15 delay means to provide an output F1 (a + b)/2, the 
temporal median filter means (22) comprising a 
temporal median selector means (88, 90, 92) con- 
nected to select and put out as an interpolated 
pixel value F1i the median one of the values F0. 

20 F1(a + b)/2 and F2 and temporal median control 
means (80, 82, 84, 86) connected to receive the 
FO, F1(a + b)/2 and F2 values for generating a 
median selection signal and for applying the signal 
to control median selection by the temporal median 

25 selector means. 

7. A pixel interpolator for generating interpola- 
tion pixels from incoming picture image pixels for 
use in a television picture scan line doubler sys- 
tem, the interpolator comprising inter-field inter- 

30 polation means (22) for generating an inter-field 
interpolation pixel, intra-field averager means (28) 
for generating an intra-field pixel average and 
switch means (26, 30) connected to switch an input 
to a line doubler of the system between the outputs 

35 of the inter-field interpolation means (22) and the 
intra-field averager means (24) in response to de- 
tection of pixel motion within the picture image, the 
interpolator being characterised in that the inter- 
field interpolation means (22) comprises temporal 

40 median filter means for generating an interpolation 
pixel by selecting the median one of a plurality of 
temporal pixel samples derived from the incoming 
video. 

8. A pixel interpolator according to claim 7, 
45 wherein the intra-field averager means (28) is con- 
nected to provide an intra-field pixel average as 
one input to the temporal median filter means (22). 

9. A pixel interpolator according to claim 7 or 
8, wherein the switch means (26, 30) comprises a 

so proportional switch means for switching proportion- 
ally from the temporal median filter means (22) to 
the intra-field averager means (28) in response to 
the level of a motion control signal representative 
of the amplitude level of motion activity as a func- 

55 tion of brightness level in the proximate vicinity of 
the pixel presently being interpolated within the 
picture image. 

10. A pixel interpolator according to claim 9, 
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wherein the motion control signal has an onset at 
approximately 3-10 IRE units and causes complete 
switch over from the temporal median filter means 
(22) to the intra-field averager means (28) at ap- 
proximately 7-15 IRE units of motion amplitude. 

11. A pixel interpolator according to clam 9 or 
10, wherein the proportional switch means (26, 30) 
establishes brightness level in the proximate vi- 
cinity of the pixel presently being interpolated by 
reference to the horizontal, vertical and temporal 
domain adjacent to said pixel. 

12. A pixel interpolator according to any one of 
claims 7 to 11, wherein the incoming picture image 
pixels comprise separated luminance pixels and 
separated chroma pixels and said temporal median 
filter means (22Y) and said intra-field averager 
means (28Y) and said switch means (26, 30) com- 
prise a luminance processor for interpolating said 
luminance pixels within said system, the interpola- 
tor further comprising a chroma processor includ- 
ing chroma temporal median filter means (25) for 
generating an interpolation pixel by selection of the 
median one of a plurality of temporal chroma pixel 
samples derived from incoming chroma, a chroma 
intra-field averager means (28C) for generating an 
intra-field chroma pixel average from incoming 
chroma, and chroma switch means (26C) connect- 
ed to switch a chroma input to the line doubler of 
the system between outputs of the chroma tempo- 
ral median filter means (25) and the chroma intra- 
field averager means (28C) in response to detec- 
tion b y the luyinarK^e switch means (2^ t| gO^gf 
pixel motion within the picture Image. 

13. A pixel interpolator according to claim 12, 
comprising chroma level detector means (94) for 
detecting chroma level at the vicinity of the lu- 
minance pixel to be interpolated and for overriding 
control by the luminance switch means (26, 30) 
whenever chroma level at the said vicinity of the 
pixel to be interpolated exceeds a predetermined 
threshold amplitude. 

14. A pixel interpolator according to claim 13, 
wherein the chroma level detector means (94) mea- 
sures red level amplitude and begins to override 
control of the chroma switch means (26C) by the 
luminance switch means (26Y, 30) whenever red 
level reaches a predetermined level in a range 
between 30 and 50 IRE units. 

15. A pixel interpolator according to claim 14, 
wherein the chroma level detector (94) causes 
smoothly proportional switching between outputs of 
the chroma temporal median filter means (25) and 
the chroma intra-field averager means (28C) as a 
function of chroma level with an onset lying in a 
range between 30 and 50 IRE units and a full-on 
lying in a range between 60 and 80 IRE units. 

16. A pixel interpolator according to any one of 
claims 7 to 15, wherein the switch means (26) 



generates a temporal median filter selection control 
signal for controlling selection of the median pixel 
by the temporal median filter means (22). 

18. In a compatible, high resolution television 
5 display system for converting conventional picture 

images into line doubled picture images for display 
on a scan-line-doubled display device, the system 
for receiving at an input a quadrature modulated 
subcarrier colour television picture composite sig- 

io nal from a source and comprising spatial comb 
filter separator means connected to the input for 
separating and putting out chrominance and lu- 
minance components of the composite signal, the 
system being characterised by temporal median 

75 filter interpolator means (22Y, 25) connected to 
receive the chrominance and luminance compo- 
nents from the spatial comb filter separator means, 
the temporal median filter interpolator means sepa- 
rately interpolating pixels from real pixels of each 

20 of the chrominance and luminance components 
and supplying real luminance component pixels, 
interpolated luminance pixels, real chrominance 
pixels and interpolated chrominance pixels to line 
doubler means (102) which includes luminance 

25 buffer memory means (14Y, 24Y) for arranging and 
putting out said real luminance component pixels 
as scan lines and said interpolated luminance pix- 
els as scan lines of a line doubled luminance 
component and chrominance buffer memory (14C, 

30 24C) for arranging and putting out said real 
chrominance component pixels as scan lines and 
said interpQlat^^ 

scan lines of a line doubled chrominance compo- 
nent, and transcoder means (104) connected to 
35 receive the line doubled luminance component and 
the line doubled chrominance component for de- 
coding and putting out three colour control signals 
to operate said line doubled display device. 

19. A display system according to claim 18, 
40 comprising colour vertical transition enhancement 

means connected to said transcoder means (104) 
for shortening the transition times of transitions of 
said three colours control signals. 

20. A display system according to claim 18 or 
45 19, wherein said temporal median filter interpolator 

means (22Y, 25) comprises luminance signal do- 
main median filter means (22Y) and chrominance 
temporal domain median filter means (25). 

21. A display system according to claim 20, 
so comprising luminance median filter bypass soft 

switch means (26Y) connected at the output of the 
luminance median filter means (22Y) for switching 
to a luminance spatial average value, chrominance 
median bypass soft switch means (26C) connected 
55 at the output of the chrominance median filter 
means (25) for switching to a chrominance spatial 
average value, and luminance motion detection 
means (30) for detecting motion in the luminance 
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component and for generating a luminance switch- 
ing control signal for operating the luminance 
median bypass soft switch means (26Y) and for 
operating the chrominance median bypass soft 
switch means (26C). 

22. A display system according to claim 21, 
comprising chrominance level detection means (94) 
for detecting chrominance level and for putting out 
a chrominance override switching control signal 
above a predetermined threshold level, the 
chrominance median bypass soft switch means 
(26C) being controlled by the luminance control 
signal below the threshold level and by the 
chrominance override switching control signal 
above the threshold level. 

23. A display system according to claim 22, 
wherein the threshold level is preestablished in a 
range of 30 to 50 IRE units. 

24. A display system according to claim 21 , 22 
or 23, wherein the onset of the luminance switching 
control signal lies in a range of 307 IRE units of 
motion amplitude. 

25. A display system according to claim 24, 
wherein the luminance switching control signal is 
substantially linear with motion amplitude and 
reaches maximum value in a range lying between 5 
and 15 IRE units. 

26. A display device according to any one of 
claims 18 to 25, wherein the spatial comb filter 
means includes two series connected line period 
delay elements. 

27. A motion detector for detecting motion in a 
video picture and for putting out a motion detection 
value, characterised by first frame delay means for 
delaying an incoming pixel F0 by two fields to put 
out a delayed pixel F2 at the time of arrival of the 
F0 pixel, difference means (32) for subtracting the 
amplitude of one of the F0 and F2 values from the 
amplitude of the other thereof and for putting out a 
difference value, sign removal means (36) for re- 
moving the sign of the difference value and for 
putting out an absolute value, threshold means (62) 
for establishing and passing the absolute value 
above a predetermined minimum threshold value, 
horizontal stretch means (64) for stretching the 
motion value over a predetermined number of pix- 
els adjacent to the said pixel and for providing an 
output (FOc and F2d) to one input of OR logic 
means (76), field delay means (68) connected to 
the output of the horizontal stretch means for de- 
laying the stretched motion value by one field 
duration and for putting out the field delayed value 
(F1 a) to a second input of the OR logic means 
(76), and line delay means (72) connected to the 
output of the field delay means for delaying the 
field delayed, stretched motion value by one scan 
line period and for putting out the field and line 
delayed value (F1b) to a third input of the OR logic 



means (76), the OR logic means (76) selecting and 
putting out as the motion detection value the signal 
at any of its inputs having the greatest absolute 
magnitude. 

5 28. A motion detector according to claim 27, 

comprising second OR logic means (40) connected 
between the sign removal means (36) and the 
threshold means (62) for receiving the output of the 
sign removal means as one input thereto and fur- 
io ther comprising recirculation loop means (44, 50, 
58, 60) including frame delay means (50) con- 
nected to the output of the sign removal means 
(36) for recirculating over frame intervals the signal 
therefrom and for putting out a weighted recircula- 
te tion component as at least one more input to the 
second OR logic means (40), the output of the 
second OR logic means (40) being the input having 
the greater amplitude of the inputs thereto. 

29. A motion detector according to claim 27 or 
20 28, wherein the threshold is adapted to put out the 
absolute value above the predetermined threshold 
which results in a motion detection value having an 
onset established in a range between 2 to 5 IRE 
units. 

25 30. A motion detector according to claim 29, 

wherein the first OR logic means (76) puts out a 
motion detection value which is substantially linear 
and reaches a full-on value in a range between 5 
and 1 5 IRE units. 

30 31. A motion detector according to claim 28, 

29 or 30, wherein the recirculation loop means (44, 
50, 58, 60) comprises the frame delay (50), a 
threshold and limiting means (58), a first amplifier 
means (60) having a predetermined coefficient of 

35 amplification lying in a range between zero to unity, 
and summing junction means (44) connected at the 
output of the sign removal means, the output from 
the summing junction means (44) providing the 
second input to the second OR logic means (40). 

40 32. A motion detector according to claim 31, 

comprising second amplifier means (46) connected 
between the output of the summing junction means 
and the second input to the second OR logic 
means (40), the second amplifier means (46) hav- 

45 ing a predetermined coefficient of amplification ly- 
ing in a range between zero and unity. 
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© Television scan line doubler including temporal median filter. 



© A video pixel interpolator generates interpolation 
pixels from incoming picture image pixels for use 
within a television picture scan line doubler system. 
The interpolator includes a temporal median filter 
(22) for generating an interpolation pixel by selection 
of the median one of a plurality of temporal pixel 
samples derived from incoming video, an intra-field 
averager means (28) for generating an intra-field 
CO pixel average, and a switch (26) connected to switch 
^an input to a line doubler of the system between 
^.outputs of the temporal median filter and the intra- 
0) field averager in response to detection of pixel mo- 
©tion within the picture image. Improved motion de- 
^tection, and multi-channel processing are also in- 
O eluded within the present invention. 
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